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TITLE OF THE INVENTION ' 

APPARATUS AND METHOD FOR REPRODUCING INTERACTIVE CONTENTS BY 
CONTROLLING FONT ACCORDING TO ASPECT RATIO CONVERSION 

CROSS-REFERENCE TO RELATED APPLICATIONS 

[0001] This application claims the benefit of Patent Cooperation Treaty (PCT) Application No. 
PCT/KR2003/2573, filed November 26, 2003, in the Korean Intellectual Property Office, which is 
based on Korean Patent Applications 2002-74479, filed November 27, 2002, and 2003-62375, 
filed September 6, 2003, in the Korean Intellectual Property Office, the disclosures of which are 
incorporated herein by reference. 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

[0002] Tt^e -An aspect of the present invention relates to a technique of reproducing an 
interactive content of an fef interactive display from an information storage medium, and^ more 
particularly, to an apparatus and method fefof reproducing an interactive content by controlling a 
font according to an aspect ratio conversion, thereby minimizing display distortion. 

2. Description of the Related Art 

[0003] Generally, audio and/or video (AV) content information and user definition information 
are types of information that are recorded on an information storage medium. The AV content 
information is a content actually reproduced from the information storage medium, and the user 
definition information is unique information that is defined by a producer. When a general 
reproducing apparatus is used, only the AV content is reproduced from the information storage 
medium. When a device such as a computer is used, the user definition information eafi -mav 
also be accessed and used. 

[0004] Recently, interactive information storage media have been commercialized. The 
interactive information storage media eafi -mav be used in a web-based environment using 
HyperText Markup Language (HTML) enabling a user interactive display. When information is 
reproduced from an interactive information storage medium, even when a general reproducing 
apparatus is used, a user can see an interactive image showing a tool, a text, or an image, 
which enables the user to access a network link and perform a search, together with an AV 
image showing an AV content. 
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[0005] FIGS. 1 A and 1 B show examples of a screen which can be displayed in an interactive 
mode. FIG. 1A shows a screen having an aspect ratio of 4:3 (hereinafter, referred to as a 4:3 
screen). FIG. 1B shows a wide screen having an aspect ratio of 16:9. 

[0006] Conventional interactive information storage media are manufactured to have a 
markup document suitable only for a 4:3 screen having a pixel aspect ratio of 1:1, such as a 
screen of a personal computer's monitor. Accordingly, when an interactive image is displayed 
on a screen of a television (TV), the interactive image is displayed in an undesired format 
because the TV screen does not have a 1:1 pixel aspect ratio, and accordingly has a different 
screen aspect ratio. In other words, when an HTML file that is suitable for a screen having a 
particular pixel aspect ratio is reproduced from a conventional interactive information storage 
medium and displayed on a screen (e.g., a 4:3 TV screen) having a different pixel aspect ratio 
from the particular pixel aspect ratio, the HTML file is not displayed in a format desired by a 
content producer, as shown in FIG. 2. 

[0007] When an interactive image is displayed on a display apparatus having a different pixel 
aspect ratio, image distortion occurs and the image has a different shape from that which is 
desired by a content producer. Therefore, there is a need for a method of displaying an 
interactive content in a format desired by a content producer without distortion on a screen 
having a pixel aspect ratio different from that of a produced markup document. 

SUMMARY OF THE INVENTION 

[0008] The -An aspect of the present invention provides an apparatus and method for 
r e producing to reproduce a n-interactive content by controlling a font according to an aspect ratio 
conversion , th e r e by m i n i mizino so as to minimize display distortion. 

[0009] Another aspect of tT he present invention atee-provides an apparatus and method for 
r e produc i ng an to reproduce interactive content by controlling a size of a font adapted to an 
aspect ratio conversion using aspect ratio information of a markup document containing the 
aspect ratio information and resolution information which are optimally suitable for the markup 
document , ther e by minim i z i no so as to minimize display distortion, 

[0010] TAnother aspect of t he present invention ateo-provides an apparatus and method for 
r e producing an to reproduce interactive content by enlarging or reducing a font having a 
predetermined pixel aspect ratio according to a resolution and an aspect ratio of a screen on 
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which the font is to be displayed , th e r e by minim i z i ng so as to minimize display distortion. 

[0011] According to an aspect of the present invention, there is provided an apparatus foF 
reproduc i ng to reproduce an interactive content from an information storage medium. The 
interactive content includes AV data including audio data and video data, a markup document, 
and/or a markup resource file. The apparatus includes a font controller-meafls. which 
determines a pixel aspect ratio of a font according to aspect ratio information and resolution 
information of an input markup document, performs a preprocess of enlarging or reducing a size 
of the font according to the determined pixel aspect ratio, and outputs the preprocessed font 
data adapt i ve according t o a change in the aspect ratio and resolution of the screen on which 
the interactive content is displayed. 

[0012] According to an aspect of the present invention, there is provided a method of 
reproducing an interactive content from an information storage medium. The interactive content 
includes AV data including audio data and video data, a markup document, and/or a markup 
resource file. The method includes determining a pixel aspect ratio of a font according to aspect 
ratio information and resolution information of an input markup document, performing a 
preprocess of enlarging or reducing the font before displaying I tthe font , and outputting the 
preprocessed font data adapt e d according t o an aspect ratio and a resolution of a screen on 
which the interactive content is displayed. 

[0013] Additional and/or other aspects and advantages of the invention will be set forth in part in 
the description which follows and, in part, will be obvious from the description, or may be 
learned bv practice of the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0014] These and/or other aspects and advantages of the invention will become apparent and 
more readily appreciated from the following description of the embodiments, taken in 
conjunction with the accompanying drawings of which: T h e abov e and oth e r f e atur e s and 
advantag es of th e pr e s e nt i nv e nt i on w ill b e come mor e appar e nt by d e scrib i ng i n d e ta i l pr e f e rr e d 
e mbod i m e nts th e r e of w i th ref e r e nc e to th e attach e d drawings in which: 

FIGS. 1A and 1B show examples of a screen which can be displayed in an interactive 

mode; 

FIG. 2 shows an example of distortion occurring when an image that is suitable for a 
screen having a 1:1 pixel aspect ratio is displayed on a screen having a 4:3 pixel aspect ratio 
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without conversion; 

FIG. 3 is a block diagram of a reproducing apparatus to which the prooont invention i s 
applie daccordino to the present invention : 

FIG. 4 is a block diagram of an apparatus for roproducinoto reproduce an interactive 
content by controlling a font according to an aspect ratio conversion, according to an 
embodiment of the present invention; 

FIG. 5 illustrates rotation of a font using control point data of font outline; 

FIGS. 6A and 6B show examples of font outputs according to prior art and an 
embodiment of t he present invention, respectively; 

FIG. 7A and 7B show other examples of font outputs according to prior art and an 
embodiment of the present invention, respectively; 

FIGS. 8A through 8C show other examples of font outputs according to an embodiment 
gLthe present invention and prior art; and 

FIG. 9 is a flowchart of a method of reproducing an interactive content by controlling a 
font according to an aspect ratio conversion, according to an embodiment of the present 
invention. 

DETAILED DESCRIPTION OF THE EMBODIMENTS 

[0015] Reference will now be made in detail to the present embodi ments of the present 
invention, examples of which are illustrated in the accomoanvin o drawings, wherein like 
reference numerals refer to the like elements throuohout. The e mbodiments are described 
below in order to explain the present invention bv referring to the figures. Horo i naftor. preferred 
ombod i monto of tho prcsont inv e ntion will bo doocribod i n deta i l with roforonco to the attached 
draw i ngs. 

[00161 FIG. 3 is a block diagram of a reproducing apparatus to which tho prooont i nvention i s 
applie daccording to an embodiment of the present invention . The reproducing apparatus 
includes a reader 1 . a buffer memory 2, a cache memory 3, a decoder 4, a control unit 5, and a 
blender 7. The control unit 5 is provided with a presentation engine 6. The reader 1 includes an 
optical pickup unit (not shown), which reads data by radiating a laser beam onto an interactive 
information storage medium 100. 

[0017] The interactive information storage medium 100 provides various types of information 
and AV convents contents . which ean -mav be displayed in a user interactive environment. The 
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interactive information storage medium 100 has a markup document containing indication 
information on a resolution and an aspect ratio of the markup document so that an interactive 
image mavs aR be appropriately displayed at a particular screen aspect ratio. Generally, a font 
having a square pixel aspect ratio is used in a markup document, but a format of the font may 
vary with content producers. 

[0018] The reader 1 controls the optical pickup unit to read AV data and a markup document 
from the interactive information storage medium 100 according to a control signal from the 
control unit 5. The buffer memory 2 buffers the AV data, and the cache memory 3 caches a 
playback control information file for oontro lli ng t o control the playback of the AV data and/or the 
markup document or caches other necessary information. The control unit 5 controls the reader 
1 , the decoder 4, the presentation engine 6. and the blender 7 so that the AV data is reproduced 
from the interactive information storage medium 100 in a video mode or an interactive mode 
according to a user's selection. 

[0019] The presentation engine 6 is an analytical engine ana l yz i ng to analyze markup 
languages and program languages such as JavaScript and Java. The presentation engine 6 
may include various plugins. The plugins enable users to open markup resource files of various 
formats, which are included in or linked to markup documents. In other words, the presentation 
engines 6 serves as a markup document viewer. In an embodiment of the present invention, the 
presentation engines 6 eaR -mav access the Internet and read predetermined data. 

[0020] The presentation engines 6 fetches a markup document from the cache memory 3. 
afid4Then . the presentation engine 6 analyzes and renders ttthe markup document in the 
interactive mode. The blender 7 then blends an AV data stream and the rendered markup 
document so that the AV data stream is displayed on a display window defined by the markup 
document, that is, an AV image is embedded in a markup document image, and outputs the 
result of blending to a display apparatus 200. 

[0021] In particular, the presentation engine 6 enlarges or reduces a font that is made at a 
square pixel aspect ratio using aspect ratio information of a markup document containing 
resolution information and the aspect ratio information which are suitable for the markup 
document in order to minimize distortion of interactive data. As a result, the interactive data gbb 
may be displayed in the original font on a screen having a different resolution and aspect ratio 
from the original resolution and aspect ratio of the markup document without distortion. 
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[0022] FIG. 4 is a block diagram of an apparatus for r e produoing t o reproduce an interactive 
content with control of a font according to an aspect ratio conversion, according to an 
embodiment of the present invention. In FIG 4, a sub-image is sub picture data overlapping a 
video image. The sub-image and the video image are provided from the decoder 4 shown in 
FIG. 3, 

[0023] A video converter 71 is controlled by a controller 72 to convert a format of the video 
image into a pan & scan format or a letterbox format according to a screen aspect ratio and a 
resolution of the display apparatus 200 or to output the video image from the decoder 4 as it-is 
without a convertiftq- ttsion thereof . A first mixer 73 mixes the video image from the video 
converter 71 and the sub-image. A video position/image size controller 74 controls a position of 
the mixed image from the first mixer 73 and a size of an AV image displayed on a screen of the 
display apparatus 200 according to input video layout information. 

[0024] A graphic image converter 75 is controlled by the controller 72 to convert a size (a 
length or a width) of a graphic image of a markup image source provided from the presentation 
engine 6 according to aspect ratio information of a document. A second mixer 76 mixes an 
output of the video position/image size controller 74 and an output of the graphic image 
converter 76 and outputs the result of mixing to the display apparatus 200 so that the result of 
mixing can -may be displayed on the screen of the display apparatus 200. The controller 72 
controls the video converter 71 and the graphic image converter 75 according to the screen 
aspect ratio and the resolution of the display apparatus 200. The blender 7 comprises the v ideo 
converter 71, the controller 72. the first mixer 73, the video position/image size controller 74. the 
graphic image converter 75, and the second mixer 76 ^ constitut e th e b le nd e r 7. 

[0025] Meanwhile, i t i s pr e f e rab le tha t in an embodiment of the invention, an interactive image 
display file is a markup document, such as a web-based document file, made using a markup 
language or a markup resource file, such as an image, an animation, or a font. 

[0026] Although not shown, the presentation engine 6 includes a markup document parser 
and a style sheet parser. A markup document is parsed by the markup document parser to 
generate a document tree, which conforms the following rules. Firstly, a root node of all nodes 
is set as a document node. Secondarily, all of the texts and various e lements in a document 
generate a node. Thirdly, a processing instruction, a comment, and a document type generate a 
node. The style sheet parser parses a style sheet, which allows a format of the markup 
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document to be freely set, to generate a style rule and a selector list. The style sheet parser 
provides the video layout information input to the video position/image size controller 74 and 
layout information of markup resources linked to the markup document (referred to as markup 
resource layout information). The markup resource layout information is input to a markup 
image mixer 64. 

[0027] Based on the document tree, an image decoder 61 decodes image data, an animation 
decoder 62 decodes animation data, and a font decoder 63 decodes text data according to font- 
related information to provide text data having an appropriate font. The font-related information 
may include Unicode information (font information for international standardization) and font 
family information or may be font information stored in a reproducing apparatus as default. 

[0028] Particularly, i n the pr e s e nt invont i on, the font decoder 63 enlarges or reduces a font 
using a matrix value that was previously set for the screen aspect ratio of the display apparatus 
200 based on aspect ratio information of the markup document output from the markup 
document parser, and outputs font data. The operation of the font decoder 63 will be described 
in detail later with reference to FIGS. 5 through 9. 

[0029] The markup image mixer 64 mixes outputs of the image decoder 61 , the animation 
decoder 62, and the font decoder 63 according to the markup resource layout information to 
generate a markup image source and provides the markup image source to the graphic image 
converter 75 of the blender 7. 

[0030] The presentation engine 6 comprises the image decoder 61 , the animation decoder 
62, the font decoder 63, the markup image mixer 64, and other units (not shown) constitut e th e 
pr e s e ntat i on e ng i n e 6 . 

[0031] Pr e f e rab l v in an embodiment of the invention , a markup document displayed in an 
interactive image contains resolution information and aspect ratio information indicating a 16:9 
screen, a 4:3 screen, a 1:1 screen, or no-relation to the screen aspect ratio which includes a 
case where no aspect ratio is set for the markup document. Table 1 shows examples of the 
resolution information and the aspect ratio information. When the markup document contains 
neither the resolution information nor the aspect ratio information, basic screen information set 
in a reproducing apparatus can be utilized. For example, the basic screen information may 
include a horizontal resolution of 720 pixels, a vertical resolution of 480 pixels, and an aspect 
ratio of 14:9. 
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Tab 


e 1 


Pixel 

aspect 
ratio 


1:1 


0.888:1 


1.186:1 


Only 

resolution 
witliout pixel 
aspect ratio 
is set 


Examples 
of use 


R720x405,A1x1 
R720x540.A1x1 
R1920x1080, A1x1 


R720x480.A4x3 
R720x576.A4x3 


R720x480, A16x9 
R720x576. A16x9 


R720x480 
R720x576 
R1920x1080 
R960x540 



[0032] The resolution information and the aspect ratio information of the markup document 
eaf vmav be embedded into the markup document using a tag, for example, <meta 
name="bestlook" content="Rresolution value,Aaspect ratio value">. In an example of 
modification, <link href="foo,css" type="text/css" device-aspect-ratio="aspect ratio value7> may 
be used. The resolution information and the aspect ratio information indicate a resolution and 
an aspect ratio at which the markup document is displayed most optimally. The following is an 
example of a markup document in which an aspect ratio and a resolution are combined. 



<?xml version="1.0" encoding ="UTF-8"?> 

<!DOCTYPE html PUBLIC-//DVD/DTD XHTML DVD-HTML1.0//EN" 

"http://www.dvdforum,org/enav/dvdhtml-1.0.dtd"> 

<html> 

<head> 

<title>720x480, 4x3 PAGE</title> 

<meta name="bestlook" content="R720x480,A4x3"/> 

<link href="foo.css" type="textfcss" device-aspect-ratio="4:3"/> 

<script language="ecmascipt"> 
<![CDATA[ 

function onload_handler() 
{ 

idpIayer.playO; 

idplayer.enable VideoTransform(O); 

//Disable first video transform when a value is 0 and enable first video 
transform when a value is 1. 
} 

]]> 

</script> 
</head> 

</body id=" docbody" onload="onload_handler()"> 

<objet style=" position: absolute; left: 150px; top: 100px; width: 370px; 

height:250px" data="dvd:video_ts" id="idplayer'V> 
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Interactive Data 
</body> 

</html> 



[0033] Generally, fonts are produced on a screen having a 1:1 (square) pixel aspect ratio. 
Information on a font is composed of a coordinate point, and thus a two-dimensional 
transformation such as enlargement, reduction, or rotation ean -mav be easily performed using 
control point data of a font outline, as shown in FIG. 5. However, a TV screen does not have the 
square pixel aspect ratio. As shown in Table 2, when a screen aspect ratio is 4:3, a pixel aspect 
ratio is 0.888:1. When a screen aspect ratio is 16:9. a pixel aspect ratio is 1.186:1. 



Table 2 



Screen aspect ratio at 720x480 (NTSC) 


4:3 


16:9 


Pixel aspect ratio 


0.888:1 


1.186:1 



[0034] Accordingly, when a font having the square pixel aspect ratio (hereinafter, referred to 
as a 1:1 font) is output to the TV screen without being changed, phenomena described below 
may occur. As shown in FIG. 6A, when a 1:1 font is output to a screen having a pixel aspect 
ratio of 0.888:1 (i.e., a screen having a resolution of 720x480 and a screen aspect ratio of 4:3) 
without being converted, the 1:1 font becomes narrow. When an interactive content is 
displayed, if the 1:1 font is enlarged at a ratio of 1.125:1 and then output to the screen having a 
pixel aspect ratio of 0.888:1 , the 1 :1 font can be displayed normally. Accordingly, the font 
decoder 63 enlarges the 1 :1 font at the ratio of 1125:1 using matrix information and then 
outputs the enlarged font to the 4:3 screen so that the font eaf ^mav be displayed normally. In 
other words, the enlarged font is reduced at a ratio of 0.999:1 on the screen having a pixel 
aspect ratio of 0.888:1 (i.e., the screen having a resolution of 720x480 and a screen aspect ratio 
of 4:3) and thus looks like the 1:1 font, as shown in FIG. 6B. 

[0035] As shown in FIG 7A, when a 1 :1 font is output to a screen having a pixel aspect ratio 
of 1.186:1 (i.e., a screen having a resolution of 720x480 and a screen aspect ratio of 16:9) 
without being converted, the 1:1 font becomes wide. When an interactive content is displayed, 
if the 1:1 font is reduced at a ratio of 0.843:1 and then output to the screen having a pixel aspect 
ratio of 1.186:1, the 1:1 font caf vmav be displayed normally. Accordingly, the font decoder 63 
reduces the 1:1 font at the ratio of 0.843:1 using matrix information and then outputs the 



9 



reduced font to the 16:9 screen so that the font can be displayed normally. In other words, the 
reduced font is enlarged at a ratio of 0.999:1 on the screen having a pixel aspect ratio of 1 .186:1 
(i.e., the screen having a resolution of 720x480 and a screen aspect ratio of 16:9) and thus 
looks like the 1:1 font, as shown in FIG. 7B. 

[0036] FIG. 8A shows an example of text data normally displayed when the font decoder 63 
enlarges or reduces a 1:1 font according to a screen aspect ratio. FIG. 8B shows an example of 
the text data narrowly displayed when the 1:1 font is output to a screen having a pixel aspect 
ratio of 0.888:1 (i.e., a screen having a resolution of 720x480 and a screen aspect ratio of 4:3) 
without being converted. FIG. 8C shows an example of the text data widely displayed when the 
1:1 font is output to a screen having a pixel aspect ratio of 1.186:1 (i.e., a screen having a 
resolution of 720x480 and a screen aspect ratio of 16:9) without being converted. 

[0037] The font decoder 63 stores values for cn l arQ i na t o enlarge or reducem§ a font 
according to aspect ratio information contained in a markup document as matrix information, as 
shown in Table 3. Table 3 shows a matrix used for a 4:3 screen (having a pixel aspect ratio of 
0.888:1 and a resolution of 720x480), a matrix used for a 16:9 screen (having a pixel aspect 
ratio of 1.186:1 and a resolution of 720x480), a matrix used for a basic 14:9 screen (having a 
pixel aspect ratio of 1 .031 :1 and a resolution of 720x480), and a matrix used for a screen having 
a pixel aspect ratio of 1:1 (wherein a resolution is 960x540 or 1920x1080). 



Table 3 



Pixel aspect ratio 


0.888:1 


1.186:1 


1.031:1 


1:1 


Matrix information 




"1.125 0" 
0 1 






"0.843 0' 
0 1 






"0.3 0 " 
0 1.0 






"1 0' 
0 1 





[0038] FIG. 9 is a flowchart of a method of reproducing an interactive content by controlling a 
font according to an aspect ratio conversion, according to an embodiment of the present 
invention. FIG. 9 shows an example of the operation of the font decoder 63 implemented in 
software. 

[0039] I t i G dot e rm i n e d lnittallv. whether a markup document contains aspect ratio information, 
for example, whether a markup document contains a tag <meta name="bestlook" 
content="Rresolution value,Aaspect ratio value"> or a modified tag <link href ="foo, ess" 



10 



type="text/css" device-aspect-ratio="aspect ratio value7> (901) is determined . If the W h e n i t i s 
dotorm i n e d that th e markup document is determined to contains the aspect ratio information, 
the aspect ratio information is input as screen aspect ratio information (902). Whon i t i s 
dotorminod thatj f the markup document doe sis determined to not contain the aspect ratio 
information, basic screen aspect ratio information set in a reproducing apparatus is input as the 
screen aspect ratio information (903). A font is enlarged or reduced using matrix information (as 
shown in FIG. 3) corresponding to the screen aspect ratio information (904), Then, font data 
composed of control points resulting from the enlargement or reduction of the font is rasterized 
for display (905). Thereafter, the rasterized font data is mixed with other elements (an image, 
animation, etc.), and the result of mixing is displayed on a screen (906). 

Industrial Aoplicabilitv 

[0040] As is_described above, according to aspects of t he present invention, when interactive 
image information optimally displayed at a particular aspect ratio is reproduced from an 
information storage medium and displayed on a screen having a different screen aspect ratio 
from the particular aspect ratio, a font is enlarged or reduced using matrix information 
corresponding to the particular aspect ratio, so that the original font desired by a content 
producer can be normally displayed on the screen, and an interactive image can be displayed 
on the screen with a minimum distortion, 

[0041] Althouoh a few embodiments of the present invention have been shown and 
described, it would be appreciated bv those skilled in the art that changes mav be made in this 
embodiment without departing from the principles and spirit of the invention, the scope of which 
is defined in the claims and their equivalents. 
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